Gaze-Aware Graph Convolutional Network for Social Relation Recognition

نویسندگان

چکیده

Social relation, as the basic relation in our daily life, is vital for social action analysis. However, how to learn feature between people still not tackled. In this work, we propose a gaze-aware graph convolutional network (GA-GCN) recognition, which targets discovering context-aware inference with attention. To predict gaze direction, apply trained direction loss. Then, build module, two-stream both attention and distance-aware The can pick up relevant context objects representation. We further introduce additional scene features construct multiple fusion adaptively representation from feature. Extensive experiments on PISC PIPA datasets demonstrate that GA-GCN find interesting contextual achieves state-of-the-art performances.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Shallow Convolutional Neural Network for Implicit Discourse Relation Recognition

Implicit discourse relation recognition remains a serious challenge due to the absence of discourse connectives. In this paper, we propose a Shallow Convolutional Neural Network (SCNN) for implicit discourse relation recognition, which contains only one hidden layer but is effective in relation recognition. The shallow structure alleviates the overfitting problem, while the convolution and nonl...

متن کامل

EMG-based wrist gesture recognition using a convolutional neural network

Background: Deep learning has revolutionized artificial intelligence and has transformed many fields. It allows processing high-dimensional data (such as signals or images) without the need for feature engineering. The aim of this research is to develop a deep learning-based system to decode motor intent from electromyogram (EMG) signals. Methods: A myoelectric system based on convolutional ne...

متن کامل

Graph Convolutional Networks for Named Entity Recognition

In this paper we investigate the role of the dependency tree in a named entity recognizer upon using a set of Graph Convolutional Networks (GCNs). We perform a comparison among different Named Entity Recognition (NER) architectures and show that the grammar of a sentence positively influences the results. Experiments on the OntoNotes 5.0 dataset demonstrate consistent performance improvements, ...

متن کامل

Graph Based Convolutional Neural Network

In this paper we present a method for the application of Convolutional Neural Network (CNN) operators for use in domains which exhibit irregular spatial geometry by use of the spectral domain of a graph Laplacian, Figure 1. This allows learning of localized features in irregular domains by defining neighborhood relationships as edge weights between vertices in graph G. By formulating the domain...

متن کامل

Tensor graph convolutional neural network

In this paper, we propose a novel tensor graph convolutional neural network (TGCNN) to conduct convolution on factorizable graphs, for which here two types of problems are focused, one is sequential dynamic graphs and the other is cross-attribute graphs. Especially, we propose a graph preserving layer to memorize salient nodes of those factorized subgraphs, i.e. cross graph convolution and grap...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2021

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2021.3096553